Quantum refrigerators and the Ill-law of thermodynamics 
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The rate of temperature decrease of a cooled quantum bath is studied as its temperature is reduced 
to the absolute zero. The Ill-law of thermodynamics is then quantified dynamically by evaluating 
the characteristic exponent £ of the cooling process dT Jf^ ~ — T^ when approaching the absolute 
zero, T — > 0. A continuous model of a quantum refrigerator is employed consisting of a working 
medium composed either by two coupled harmonic oscillators or two coupled 2-level systems. The 
refrigerator is a nonlinear device merging three currents from three heat baths: a cold bath to be 
cooled, a hot bath as an entropy sink, and a driving bath which is the source of cooling power. A 
heat driven refrigerator (absorption refrigerator) is compared to a power driven refrigerator. When 
, optimized both cases lead to the same exponent f, showing a lack of dependence on the form of 

the working medium and the characteristics of the drivers. The characteristic exponent is therefore 
determined by the properties of the cold reservoir and its interaction with the system. Two generic 
heat baths models are considered, a bath composed of harmonic oscillators and a bath composed 
from ideal Bose/Fermi gas. The restrictions on the interaction Hamiltonian imposed by the Ill-law 
are discussed. In the appendix the theory of periodicaly driven open systems and its implication to 
thermodynamics is outlined. 

O I. INTRODUCTION 

+-> \ 

Thermodynamics was initially formed as a phenomenological theory, the fundamental rules are assumed as pos- 
tulates based on experimental evidence. The well-established part of the theory concerns quasi-static macroscopic 
processes near thermal equilibrium. Quantum theory, on the other hand, treats the dynamical perspective of systems 
i— i' at atomic and smaller length scales. Although the two disciplines reliant upon different sets of axioms, one of the 
first developments, Planck's law, that led to the basics of quantum theory was achieved thanks to consistency with 
thermodynamics. Einstein, following the ideas of Planck on black body radiation, quantized the electromagnetic field 

a. 

With the establishment of quantum theory, Quantum thermodynamics emerged as the quest to reveal the intimate 
£C) ' connection between the laws of thermodynamics and their quantum origin l2T4l9l]. In this tradition the present 
7-H , study is aimed toward the quantum study of the third law of thermodynamics [20l - |24j , in particular quantifying the 
' unattainability principle. Apart from the fundamental interest in the emergence of the third law of thermodynamics 
from a quantum dynamical system, cooling mechanical systems reveal their quantum character. As the temperature 
£NJ ■ decreases, degrees of freedom freeze out, leaving a simplified dilute effective Hilbert space. Ultra-cold quantum systems 
contributed significantly to our understanding of basic quantum concepts. In addition, such systems form the basis 
for emerging quantum technologies. The necessity to reach ultra-low temperatures requires a focus on the cooling 
process itself, quantum refrigeration. 

The minimum requirement for constructing a continuous refrigerator is a system connected simultaneously to three 
reservoirs |25| . These baths are termed hot, cold and work reservoir as described in Fig. [TJ This framework has 
to be translated to a quantum description of its components which include the Hamiltonian of the system H s and 
the implicit description of the reservoirs. We present a careful study on the influence of different components and 
cooling mechanisms on the cooling process itself. Namely, we consider a working medium composed of two harmonic 
oscillators or two 2-level system (TLS). Two generic models of the cold heat bath are considered, a phonons and 
an ideal Bose/Fermi gas heat bath. Another classification of the refrigerator is due to the character of the work 
reservoir. The first studied example is a heat driven refrigerator, an absorption refrigerator model proposed in [24j], 
where T w 3> Th > T c [36[ . In a power driven refrigerator the work reservoir represents zero entropy mechanical work, 
which is modeled as a periodic time dependent interaction Hamiltonian. 

The models studied contain universal quantum features of such devices. The Ill-law of thermodynamics is quantified 
by the characteristic exponent £ of the change in temperature of the cold bath ~ — T£ when its temperature 

approaches the absolute zero, T c — > 0. The exponent £ is determined by a balance between the heat capacity of the 
cold bath and the heat current J c into the cooling device. When the performance of the refrigerator is optimized, the 
final Ill-law characteristics are found to be independent of the refrigerator type. 

The analysis is based on a steady state operational mode of the refrigerator. Then, the first and second laws of 
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FIG. 1: A quantum heat pump designated by the Hamiltonian H s coupled to a work reservoir with temperature T m , a hot 
reservoir with temperature Th and a cold reservoir with temperature T c . The heat and work currents are indicated. In steady 
state J h + J c + V = 0. 



thermodynamics have the form: 

Jh+Jc + V = 



T h T c T„ — u ' 



where Jk are the stationary heat currents from each reservoir. The first equality represents conservation of energy 
(first law) [lH, 

and the second inequality represents non-negative entropy production in the universe S u > (second 
law). The fulfillment of the thermodynamical laws are employed to check the consistency of the quantum description. 
Inconsistencies can emerge either from wrong definitions of the currents Jk or from erroneous derivations of the 
quantum master equation. In Appendix I we present a short and heuristic derivation of such a consistent Markovian 



master equation based on the rigorous weak coupling |26j or low density 27| limits for a constant system's Hamiltonian. 
Its generalization to periodic driving proposed in [28[ and based on the Floquet theory is briefly discussed in Appendix 
II. Finally, in Appendix III the definition of heat currents is proposed which satisfy the second law of thermodynamics, 
not only for the stationary state, but also during the evolution from an arbitrary initial state of the system. It allows 
also to compute an averaged power in the stationary state. 



II. QUANTUM ABSORPTION REFRIGERATORS 

We dev elop and discuss in detail the model of quantum absorption refrigerator proposed in (24|. We extend the 
results of [2J| treating by the same footing the original model with two harmonic oscillators and its two 2-level systems 
counterpart to stress the universality of the proposed cooling mechanism. The advantage of the absorption refrigerator 
is its underlying microscopic model with time-independent Hamiltonian. 



A. Absorption refrigerator model 

The model consists of two harmonic oscillators or two TLS (^4 and B) which are described by two pairs of annihilation 
and creation operators satisfying the commutation or anticommutation relations 

aa) + ea)a = 1, aa + eaa = 0, 66 f + eb^b =l,bb + ebb = (2) 

with e = 1 for the TLS and e = — 1 for oscillators. The system A (B) is coupled to a hot(cold) bath at the temperature 
Th (T c ) and there exists a collective coupling of A + B to the third "work bath" at the temperature T w » Th > T c . 
The nonlinear coupling to the bath is essential. A linearly coupled working medium cannot operate as a refrigerator 
[37j . The Hamiltonian of the working medium A + B is given by 



H = LUha a + u! c b b ,u>h > ^>c 



(3) 
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and the interaction with the three baths (hot, cold and work) are assumed to be of the following form 

H mt = (a + a+) ® R h + (b + b + ) ® R c + (ab + + a + b) ® R w . (4) 

with being the corresponding bath operator. 

Applying now the derivation of the Markovian dynamics based on the weak coupling limit (see Appendix I) one 
obtains the following Markovian master equation involving three thermal generators 

£ h p + £ c p + £ w p (5) 



e- pkUh [a*,pa] + h.c.} (6) 
e-P° u °\tf,pb]+h.c) (7) 

C w p=^ w ([ab\p^b} + e-^^-^\^b,pab^} + h.c)j (8) 

and f3 c > f3h >> f3 w are inverse temperatures for the cold, hot and work bath, respectively. 

The values of relaxation rates 7/j, j c , j w > depend on the particular models of heat baths and their explicit form 
is discussed in Appendix I. Notice, that one can add also the generators describing pure decoherence (dephasing) in 
the form 

V h p = ~S h [a^a, [a*a,p]} , V cP = ~8 e [b^b, [tfb,p]} , 8 h ,8 c > (9) 

which, however, do not change the evolution of diagonal matrix elements and therefore have no influence on the 
cooling mechanism at the stationary state. The generator C w is not ergodic in the sense that it does not drive the 
system A + B to a Gibbs state because it preserves a total number of excitations a) a + b^b. This fault can be easily 
repaired by adding to C w a term of the form ([5]) or/and ([7]) but with the temperature T w . However, we assume that 
the processes described by iJB])-® dominate and additional contributions can be neglected. 



where 

£-hP = -jlh{[a,pa ] ] + 
C cP =\ lc ([b,ptf] + 



B. The cooling mechanism 



The stationary "cold current" describing heat flux from the cold bath to the working medium can be computed 
using the definitions presented in Appendix III. The cooling of the cold bath takes place if this current is positive 



J c =uj c Tr[(£ c p)tfb)] > 0. 



(10) 



To compute J c we need the following equations for the mean values of the relevant observables — Tr(pa^a) and 
fi c = Ti(pb + b) which can be derived using the explicit form of the generators 



dt 



dt 



where R is the non linear rate 



-7 h (l + ee-^ w ")n h + 7 h e-^ w " +^ w (n c -n h )-R 
-7c(l + ee- PeU °)nc + j c e~^ + -y w (n h -n c ) + R 

R = j w (l- e-^^ h -^))Tr[p(b+b)(aa+)] 



(11) 
(12) 

(13) 



Eqs. (|lUl5)l can be solved analytically in the high temperature limit for the work bath f3 w — > which implies R — > 0. 
Under this condition the stationary cold current reads 



Jc = LUcln 



(< 



l + 7« 



+ ee-P^») +7c 1 (l + ee-^ w «)" 



(14) 



4 



The cooling condition J c > is equivalent to a very simple one 

^ < (15) 
One can similarly compute the other heat currents to obtain the coefficient of performance (COP) 

COP = = — — — . (16) 

which becomes the Otto cycle COP BUI]. 

We are interested in the final stage of the cooling process when the temperature T c is close to absolute zero and 
hence we can assume that 'y c (T c ) << jh(Th) while keeping essentially constant the value uj c /T c . This leads to the 
following simplification of the formula (TT4"|) 

J e ^u e y c e- u ^ kBT '. (17) 



III. PERIODICALLY DRIVEN REFRIGERATOR 

Instead of driving the refrigerator by a "very hot" heat bath we apply resonant time-dependent perturbation to 
the system of two harmonic oscillators. One can repeat the derivation for 2 TLS but the final expressions for the 
currents are more intricate and therefore we restrict ourselves to the oscillator working medium. The time-dependent 
Hamiltonian reads 

H(t) = u) h a)a + Lu c tfb + A(e _in V& + e in W) , ft = ui h - lj c , A > 0. (18) 
Interaction with the baths is given by 

H int = (a + d)®R h + (b + tf)®R c . (19) 
The weak coupling limit Markovian master equation obtained by the methods discussed in Appendix II is of the form 

j t p(t) = -i[H(t), P (t)} + C h {t)p{t) + C c (t)p(t). (20) 

with Ch( c ){t) — U{t,O)Ch(c)U(t,0y that can be derived directly without applying the full Floquet formalism. 
The main ingredients of the derivation: 

I) Transformation to interaction picture. The baths operators transform according to the free baths Hamiltonian, 
and the system operators according to the unitary propagator (under resonance conditions) 



U(t, 0) = T exp|-i J H(s)ds} = e - iH ° 



l e~ lV \ (21) 



where 

H = oj h a^a + Lj c tfb , V = A(a f 6 + a6 f ) . (22) 
II) Fourier decomposition of the interaction part 

a(t) = U(t, 0)W(i, 0) = e iVt \e iHot ae- iH ° 1 e~ ivt = cos{\t)e' iuJht a - i sm(\t)e- lUht b, (23) 

which gives the Fourier decomposition (compare with eq.(|7ip) 

a(t) = J-( e - i ^ t d + + e -<(w * >*<!_) (24) 
v 2 



and 



6(4) = ^={e- i ^ t d+ - e" l( ^ )4 d_) (25) 
v2 
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where cL 



£#, d. 



and > = (w/i( c ) i A). Similarly we can calculate af(t), b^(t). 



III) Performing the weak coupling approximation, the total time-independent (interaction picture) generator has 
the form 



where 



and 



C 



(+) 

h(c) 



1 (-) 



(26) 



(27) 



(28) 



with the relaxation rates tS) = Jh(c)(^h(c) i ^) discussed explicitly in Appendices I, II. Any such generator and any 
sum of them possess a unique stationary state (under condition LOh( c ) i A > 0). 



~P [ h(l) = Z 1 exp[~f3 h(c) uj+ (c) d\d + 



+ Jt 



(29) 



and 



$j(c) = Z le:E P[-^(c)W h(c) dld_] (30) 
The steady (time-independent) heat currents can be computed using the definitions of the Appendix III. For example, 



Jc 



-knT r 



Tr((4 +) p) lnp<+>) + Tr((4-)p) lnp, 



which can be calculated analytically. The result is the following 



Jc 



(e 



l)- 1 - (e^< - I)- 1 



[ 7 (")(1 _ e -ft^)]-i + [ 7 (-)(i - e -A<-«-)]- 



[ 7 (+)(l _ e -A,<)]-i + [ 7 W(i - e -^+) 



(+)/ 



(31) 



(32) 



Similarly to Sec. Ill Bl when the temperature T c is close to absolute zero we can assume 7 C <C 7^ and 7c + ' ) <C 7^ 
while keeping A/T c < lu c /T c as constants. Which simplifies formula (|32|) 



1 r 



Jc - 2 



(33) 



Notice that the cold current does not vanish when A tends to zero, which obviously should be the case. It is due 
to the fact that the derivation of master equations in the weak coupling regime involves time averaging procedures 
eliminating certain oscillating terms. This procedure makes sense only if the corresponding Bohr frequencies are 
well-separated. In our case it means that uj~ should be well-separated from uj~^ which implies that A ~ uj c . Indeed, if 
both uj c and A vanish, the cold current vanishes as well. This problem of time-scales in the weak coupling Markovian 
dynamics has been discussed, for constant Hamiltonians, in [3(| (see also [3l[ for the related "dynamical symmetry 
breaking" phenomenon) . 



IV. THE DYNAMICAL HI-LAW OF THERMODYNAMICS 



There exist seemingly two independent formulations of the Ill-law of thermodynamics, both originally stated by 
Nernst (20L 12^. The first is a purely static (equilibrium) one, also known as the Nernst heat theorem and can simply 
be phrased: 

A) The entropy of any pure substance in thermodynamic equilibrium approaches zero as the temperature approaches 
zero. 

The second is a dynamical one, known as the unattainability principle: 

B) It is impossible by any procedure, no matter how idealized, to reduce any assembly to absolute zero temperature 
in a finite number of operations 32] . 
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Different studies investigating the reiation between the two formulations, led to different answers regarding which 
and if at all one of these formulation imply the other. Although interesting, this question is out of the scope of this 
paper and for further considerations regarding the third law we refer the readers to 0, H^-S] • We shall use a more 
concrete version of the dynamical Ill-law which can be expressed as: 

B') No refrigerator can cool a system to absolute zero temperature at finite time. 

This formulation enables to quantify the Ill-law, i.e. evaluating the characteristic exponent £, of the cooling process 
dT }f > ~ — for T — > 0. Namely, for £ < 1 the system is cooled to zero temperature at finite time. As a model 
of refrigerator we use the discussed above continuous refrigerators with a cold bath modeled either by a system of 
harmonic oscillators (bosonic bath) or the ideal gas at low density including the possible Bose-Einstein condensation 
effect. To check under what conditions the Ill-law is valid, we consider a finite cold bath with the heat capacity cy(T c ) 
cooled down by the refrigerator with the optimized time-dependent parameter co c (t) and the additional parameter 
A(i) for the case of periodically driven refrigerator. The equation which describes the cooling process reads 

c y (T c (<))^^ = -J c [u c (t),T c (t)] ,t > 0. (34) 

The Ill-law would be violated if the solution T c (t) would reach zero at finite time to. Now we can consider two generic 
models of the cold heat bath. 



A. Harmonic oscillator cold heat bath 



This is a generic type of a quantum bath including, for example, electromagnetic field in a large cavity or finite but 
macroscopic piece of solid described in the thermodynamic limit. We assume the linear coupling to the bath and the 
standard form of the bath's Hamiltonian 

H int = (b + tf) l^(g(k)a(k)+g(k)a^k))\ , H B = £>(fc)at( k)a(k) (35) 

V k / k 

where a{k),a'(k) are annihilation and creation operators for a mode k. For this model the weak coupling limit 
procedure leads to the generator ([7]) with the cold bath relaxation rate 

7c ee 7c K) = tt(£ \g(k)\ 2 5{uj(k) - Wc )[l - e -«(*)/*BT e] -i (36) 

k 

For the bosonic field in d-dimensional space, where k is a wave vector, and with the linear low-frequency dispersion 
law (ui(k) ~ |fc|) we obtain the following scaling properties at low frequencies (compare Appendix IV) 

7c ~w>f- 1 [l-e^/ fcBT =]- 1 (37) 

where ui^ represents scaling of the coupling strength |g(w)| 2 and the density of modes scaling. It implies the 

following scaling of the cold current 



Jc ~ 



d+K I 



Optimization of (|38| with respect to lo c leads to the frequency tuning uj c ~ T c and the final current scaling 

Taking into account that for low temperatures the heat capacity of the bosonic systems scales like 

c v {T c )~T* 

which finally produces the following scaling of the dynamical equation (|34|) 

dT c (t) 



dt 



<T C ) K . 



(38) 

(39) 
(40) 

(41) 
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Notice that in a similar way the same scaling (|4"Tj) is achieved for the periodically driven refrigerator (|33|) . with the 
optimization tuning cj c , A ~ T c . 

As a consequence, the Ill-law implies a rather unexpected constraint on the form of interaction with a bosonic bath 

K > 1. (42) 

For standard systems like electromagnetic fields or acoustic phonons with linear dispersion law u>(k) = v\k\ and the 
form-factor g(k) ~ |fc|/-v/a7(fc) the parameter « = 1, as for low w, |<?(w)| 2 ~ \k\. However, the condition (|42j) excludes 
exotic dispersion laws Ui(k) ~ |fc| a with a < 1 which anyway produce the infinite group velocity forbidden by the 
relativity theory. Moreover, the popular choice of Ohmic coupling is excluded for systems in dimension d > 1. The 
condition (|42j) can be also compared with the condition 

n>2-d (43) 

which is necessary to assure the existence of the ground state for the bosonic field interacting by means of the 
Hamiltonian (|35|) (see Appendix IV). 



B. Ideal Bose/Fermi gas cold heat bath 

We consider now a model of a cooling process where part B of the working medium is a (infinitely) heavy particle 
with the internal structure approximated (at least at low temperatures) by a TLS immersed in a low density gas at 
temperature T c . The Markovian dynamics of such a system was rigorously derived by Dumcke [27] in the low density 
limit and iV- level internal structure. The form of the corresponding LGKS generator is presented in Appendix I. For 
our case of TLS, we have only one Bohr frequency uj c , because elastic scattering corresponding to to — does not 
influence the cooling process. Cooling occurs due to the non-elastic scattering, giving the relaxation rate (Appendix 
I) 



7c = 2™ / d 6 p J d 6 &5{E(j/) - E(p) - hw c )f Tc (p g )\T(p\p)r (44) 

with n the particles density, frSPg) the probability distribution of the gas momentum strictly given by the Maxwell 
distribution, p and p' the incoming and outgoing gas particle momentum respectively. E(p) — p 2 /2m denotes the 
kinetic energy of gas particle. 

At low-energies (low-temperature), scattering of neutral gas at 3-d can be characterized by s-wave scattering length 
a s , having a constant transition matrix, |T| 2 = (-^f^) 2 - For our model the integral (l4"4"|) is calculated 

7c = (4.) 4 (^-)^a 2 ^ c /C 1 (^)e^ (45) 

where JC p {x) is the modified Bessel function of the second kind. Note that formula (|45p is also valid for an harmonic 
oscillator instead of TLS, assuming only linear terms in the interaction and using the Born approximation for the 
scattering matrix. 

Optimizing formula (|17p with respect to uj c leads to lo c ~ T c and to scaling of the heat current 

J°P l ~n{T c )^ (46) 

When the Bose gas is above the critical temperature for the Bose-Einstein condensation the heat capacity cy and 
the density n are constants. Below the critical temperature the density n in formula (|44|) should be replaced by the 
density n ex of the exited states, having both cy, n ex ~ (T c )z which finally implies 

~ - (Tc)i (47) 

In the case of Fermi gas at low temperatures only the small fraction n ~ T c of fermions participate in the scattering 
process and contribute to the heat capacity, the rest is "frozen" in the "Dirac sea" below the Fermi surface. Again, 
this effect modifies in the same way both sides of ([M]) and therefore (14T1) is still valid. Similarly, a possible formation 
of Cooper pairs below the critical temperature does not influence the scaling (|47)) . 
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V. CONCLUSIONS 

Wc have introduced and analysed two types of continuous quantum refrigerators, an absorption refrigerator and a 
periodically driven refrigerator. The latter required presenting new definitions for heat flow for periodically driven 
open systems, these definitions are in line with the II-law and are applicable for time independent Hamiltonian as 
well. Unlike the first and second laws, the third law of thermodynamics does not define a new state functions. In its 
first formulation (cf. section ITVT) the third law provides a reference point for scaling the entropy and becomes intuitive 
when thinking in terms of quantum states or levels. The second formulation, the dynamical one B' in section IIV| 
provides information on the characteristic exponent £, the speed of cooling and gives an insight and restriction on 
properties of realistic systems. 

Universal behaviour of the final scaling near the absolute zero is obtained, The Ill-law does not depend on the bath 
dimension. The type of refrigerator, absorption or periodically driven refrigerator, does not influence the characteristic 
exponent. Nor does a different medium, i.e. harmonic oscillator and TLS produce the same scaling. The characteristic 
exponent is governed only by the feature of the heat bath and its interaction with the system. For an harmonic 
oscillator heat bath the Ill-law imposes a restriction on the form of the interaction between the system and the bath, 
k > 1. Allowing only physical coupling and dispersion relations, thus for phonons with a linear dispersion relation 
£ = k = 1. For ideal Bose/Fermi gas heat bath £ = 3/2, which implies faster cooling of the phonons bath than the gas 
bath. This distinction between the two baths may occur due to particle conservation for the gas, indicating a more 
efficient extraction of heat by eliminating particles from the system. The key component of a realistic refrigerator 
is the heat transport mechanism between the heat bath and the working medium. This mechanism determines the 
III law scaling. The working medium is a non linear device combining three currents. If it is optimized properly by 
adjusting its internal structure it does not pose a limit on cooling. 
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VI. APPENDIX I. THERMAL GENERATORS FOR A CONSTANT HAMILTONIAN 

Consider a system and a reservoir (bath), with a "bare" system Hamiltonian H° and the bath Hamiltonian H R , 
interacting via the Hamiltonian XHi nt — XS ® R. Here, S (R) is a Hermitian system (reservoir) operator and A is the 
coupling strength (a generalization to more complicated Hi nt is straightforward) . We assume also that 

[PR, H a ] = 0, Tr(p R R) = 0. (48) 

The reduced, system-only dynamics in the interaction picture is defined as a partial trace 

P (t) = A(t,0)p=TT R (U x (t,0)p® PR U x (t,oy) (49) 

where the unitary propagator in the interaction picture is given by the ordered exponential 

U x (t,0) =Tcxp{^^ S(s)®R(s)ds} (50) 

where 

S{t) = e m)Ht Se -(i/H)Ht^ R (q = e (i/H)H RtRe -(i/H)H R t_ ( 51 ) 

Notice, that S(t) is defined with respect to the renormalized, physical, H and not H° which can be expressed as 

H = H a + \ 2 H{ m + ■■■ . (52) 

The renormalizing terms containing powers of A are Lamb-shift corrections due to the interaction with the bath which 
cancel afterwards the uncompensated term H — H° which in principle should be also present in (1501) . The lowest 
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order (Born) approximation with respect to the coupling constant A yields _ff™ rr , while the higher order terms (• • ■ ) 
require going beyond the Born approximation. 

A convenient, albeit not used in the rigorous derivations, tool is a cumulant expansion for the reduced dynamics 

oo 

A(i, 0) = exp [X l K {n) 0)] , (53) 

71=1 

One finds that = and the Born approximation (weak coupling) consists of terminating the cumulant expansion 
at n = 2, hence we denote = K: 

A(i, 0) = exp[A 2 A(t) + 0(A 3 )]. (54) 

One obtains 



K{t)p — To I ds [ duF(s — u)S(s)pS(u) J< + (similar terms) 
ft Jo Jo 



(55) 



where F(s) = Tt(pjiR(s)R). The similar terms in Eq. ()55j) are of the form pS(s)S(uy and S(s)S(uy p. 

The Markov approximation (in the interaction picture) means in all our cases that for long enough time one can 
use the following approximation 

K{t) ~ tC (56) 

where £ is a Linblad-Gorini-Kossakowski-Sudarshan(LGKS)- generator. To find its form we first decompose Sit) into 
its Fourier components 

S{t) = Y J ^ t S u , S-^ = St (57) 
M 

where the set {cj} contains Bohr frequencies of the Hamiltonian 

H = J2^\k){k\, u = e k ~e t . (58) 



Then we can rewrite the expression (J55J) as 

1 pt rt — U 

K ^P = la S "P S l / e^-^du F(r)e lulT dT + (similar terms). (59) 

ft , Jo J-u 



and use two crucial approximations: 



t pt—u poo 

e^-^duntS^,, / F{r)e iulT dr & G{w) = F(r)e iuT dT > 0, 

J —u J — OO 



(60) 



This makes sense for t 3> max{l/(w — w')}. Applying these two approximation we obtain K{t)ps — 
{t/h 2 )J2uj SuipsS^Giuj) + (similar terms), and hence it follows from Eq. (|56| that £ is a special case of the LGKS 
generator derived for the first time by Davies (26[. Returning to the Schrodinger picture one obtains the following 
Markovian master equation: 

ft = J f-»\^»- 

Several remarks are in order: 

(i) The absence of off-diagonal terms in Eq. (|6"Tj) , compared to Eq. (|59")l , is the crucial property of the Davies generator 
which can be interpreted as a coarse-graining in time of fast oscillating terms. It implies also the commutation of C 
with the Hamiltonian part [H, •]. 
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(ii) The positivity G(lu) > follows from Bochner's theorem and is a necessary condition for the complete positivity 
of the Markovian master equation. 

(iii) The presented derivation showed implicitly that the notion of bath's correlation time, often used in the literature, is 
not well-defined - Markovian behavior involves a rather complicated cooperation between system and bath dynamics. 
In other words, contrary to what is often done in phenomenological treatments, one cannot combine arbitrary H 's with 
a given LGKS generator. This is particularly important in the context of thermodynamics of controlled quantum open 
system, where it is common to assume Markovian dynamics and apply arbitrary control Hamiltonians. Erroneous 
derivations of the quantum master equation can easily lead to violation of the laws of thermodynamics. 

If the reservoir is a quantum system at thermal equilibrium state the additional Kubo-Martin-Schwinger (KMS) 
condition holds 

G(- W ) = exp(-^)G(w), (62) 
where T is the bath's temperature. As a consequence of (l6"2"j) the Gibbs state 

is a stationary solution of (I5T1) . Under mild conditions (e.g : "the only system operators commuting with H and S 
are scalars" ) the Gibbs state is a unique stationary state and any initial state relaxes towards equilibrium (" 0-th law 
of thermodynamics"). A convenient parametrization of the corresponding thermal generator reads 

Cp=\ ]T 7 M{([5a,,pSt] + [ 1 5 w p, ( 9t]) + e - ft ^([ 1 St ) p5 w ] + [ 1 9tp ) 5 w ])} (64) 



2 

{u>>0} 



where finally 



\2 r+oo 

7 (w) = ^ / Tr(p R e iHRt / h R e'^^R) dt. 



(65) 



A closer look at the expressions (|64|) (|65|) shows that the transition ratio from the state \k) to the state \l) is exactly 
the same as that computed from the Fermi Golden Rule 

W{\in) -> |/m)) = ^-\{in\V\fin)\ 2 S{E fin - E m ). (66) 

Namely, one should take as a perturbation V — \S®R, an initial state \in) = |fe) ® \E), a final state \fin) = \l) <g> \E') 
(\E)- reservoir's energy eigenstate), and integrate over initial reservoir's states with the equilibrium distribution and 
over all final reservoir's states. 

The above interpretation allows to justify the extension of the construction of thermal generator to the case of heat 
bath consisting of non- interacting particles at low density n and thermal equilibrium (see [271 ] for rigorous derivation) . 
In this case a fundamental relaxation process is a scattering of a single bath particle with the system described by 
the scattering matrix T. The scattering matrix can be decomposed as T = &w <8 Ru where now R u are single 

particle operators. Then the structure of the corresponding master equation is again given by (1641) with 

7 (w) = 2vm J d 3 p J d 3 p'6(E(pi) - E(p) - hw)M{p)\T u {p> ,p)| 2 (67) 

resembling a properly averaged expression (|66]l. Here the initial (final) state has a structure \k) ® \p) ( \l) ® \p')), M(p) 
is the equilibrium (Maxwell) initial distribution of particle momenta, with \p) being particle momentum eigenvector, 
E(p) kinetic energy of a particle. The perturbation V in (|6"6l is replaced by the scattering matrix T (equal to V for 
Born approximation) and finally 

T u (p',p) = (p'\Ru\p). (68) 



VII. APPENDIX II. THERMAL GENERATORS FOR PERIODIC DRIVING 



In order to construct models of quantum heat engines or powered refrigerators we have to extend the presented 
derivations of Markovian master equation to the case of periodically driven systems. Fortunately, we can essentially 
repeat the previous derivation with the following amendments: 
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1) The system (physical, renormalized) Hamiltonian is now periodic 

H(t) = H(t + r), U(t,0) = Texp{-- / H(s)ds}, (69) 

" Jo 

and the role of constant Hamiltonian is played by H defined as 

H = ^k\k)(k\, U(T,0) = e- im / h . (70) 



fc 



2) The Fourier decomposition (|57p is replaced by the following one 

U(t, 0)t 5 Cf (i, 0) = J] J] e^+^'S^, (71) 

where SI = 2it/t and {w} = {£& — £;}. The decomposition of above follows from the Floquet theory, however for our 
model we can obtain it directly using the manifest expressions for the propagator U(t, 0). 

3) The generator in the interaction picture has form: 

£ = EE = £ -/ ( 72 ) 

where 

C uq p = i 7 (w + qO){([S uq ,pSl q ] + [S uqP , Sjj) + e- H ^ + ^([St q ,pS uq } + [Sl q p, S uq })}. (73) 
Returning to the Schrodinger picture we obtain the following master equation: 

Ml = -l[H(t),p{t)]+£(t)p(t), t>0. (74) 

where 

c{t) = c(t + t) =u(t,o)cu(t,oy, u(t,oy = u(t,o) ■ u(t,oy. (75) 

In particular one can represent the solution of (|74l) in the form 

p{t) = U{t,Q)e ct p{&), t>0. (76) 

Any state, satisfying Cp = 0, defines a periodic steady state (limit cycle) 

p{t) =U(t,0)p = p(t + r), i>0. (77) 

Finally one should notice that in the case of multiple couplings and multiple heat baths the generator L can be always 
represented as an appropriate sum of the terms like (|64[) . 



VIII. APPENDIX III. HEAT FLOWS AND POWER FOR PERIODICALLY DRIVEN OPEN SYSTEMS 

We consider a periodically driven system coupled to several heats with the additional index j labeling them. Then 
the generator in the interaction picture has form 

M 

i=l q£Z {u>0} 

where any single C J uq has a structure of (|73[) with the appropriate "fj(co) . Notice, that a single component is also 
a LGKS generator and possesses a Gibbs-like stationary state written in terms of the averaged Hamiltonian H 



pl q = Z exp| —j^rj, (79) 
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The corresponding time-dependent objects satisfy 

4* (*)&(*) = °> C^{t)=U(t,Q)£{jU(t t 0)1, ~pP qu {t) =U(t,0)fP qu = f? qui (t + T) . (80) 

Using the decomposition (|78p , one can define a local heat current which corresponds to the exchange of energy uj + qQ 
with the j-th heat bath for any initial state 

Jl(t) = ^^Tr[(CUt)p(t))H(t)], H(t)=U(t,0)H, (81) 

or in the equivalent form 

J&(t) = -k B T 3 Tr[(£J qL0 (t)p(t)) ln^(i)] . (82) 
The heat current associated with the j-th bath is a sum of the corresponding local ones 

J j (t)=-^iE E Tr[(£^(t)p(t))ln^(i))]. (83) 

q£Z {ui>0} 

In order to prove the II-law we use Spohn's inequality Q 

Tr([£p][lnp-lnp]) < (84) 

valid for any LGKS generator C with a stationary state p. 

Computing now the time derivative of the entropy S(t) = — fe^Tr/?^) In p(t) and applying one obtains the 
II-law in the form 

3=1 3 

where S{t) = -k B Tr(p(t) In p(t)). 

The heat currents in the steady state p(t) are time-independent and given by 

Ji = -k B T 3 E E Hi^P) ln ^-)] • (86) 

g£Z {u>>0} 



They satisfy the II-law in the form 



while, according to the I-law 



M ft 

Y,jr<0 (87) 



M 

- e j° = -3 = ? 

3 = 1 

is the averaged power (negative when the system acts as a heat engine). Notice, that in the case of a single heat bath 
the heat current is always strictly positive except for the case of no-driving when it is equal to zero. 

Notice, that for the constant Hamiltonian the formulas of above are also applicable after removing the index q, 
what implies also that J2jLi 3^ = 0- 

IX. APPENDIX IV. VAN HOVE PHENOMENON 

A natural physical stability condition which should be satisfied by any model of open quantum system is that its 
total Hamiltonian should be bounded from below and should possesses a ground state. In the case of systems coupled 
linearly to bosonic heat baths it implies the existence of the ground state for the following bosonic Hamiltonian 
(compare with (|35j0 

H bos = J2{^(kW (k)a(k) + (g{k)a(k) + g{k)a\k))} (89) 
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we can write 



Introducing a formal transformation to a new set of bosonic operators 

a(k) ^ b{k) = a{k) + ffl (90) 

H bos =J2"(k)bHk)b(k) - E , E =Y, ll W- ( 91 ) 

fc k ' 

with the formal ground state |0) satisfying 

6(fc)|0) = 0, for all k. (92) 

For the interesting case of infinite set of modes {fc}, labeled by the (i-dimensional wave vectors, two problems can 
appear: 

1) the ground state energy Eq can be infinite, i.e. does not satisfy 
2) the transformation (|90p can be implemented by a unitary one, i.e. b(k) = Ua(k)W if and only if 

\g(k)\ 2 ^ (QA , 

L^<°°- ( 94 ) 

Non-existence of such a unitary implies non-existence of the ground state (|92[) (in the Fock space of the bosonic field) 
and is called van Hove phenomenon [35] . 

While the divergence of the sums (|93 p .(|94 p (or integrals for infinite volume case) for large |fc| can be avoided 
by putting ultra-violet cutoff the stronger condition (|94[1 puts restrictions on the form of g(k) at low frequencies. 
Assuming, that cu(k) = v\k\ and g(k) = g(u) the condition (|94|) is satisfied for the following low-frequency scaling in 
the d-dimesional case 

| 5 (u;)| 2 - w K , k > 2-d. (95) 
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